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Abstract 

We introduce the concept of a semigroup coupled cell network and show that the collection 
of semigroup network vector fields forms a Lie algebra. This implies that near a dynamical 
equilibrium the local normal form of a semigroup network is a semigroup network itself. 
Networks without the semigroup property will support normal forms with a more general 
network architecture, but these normal forms nevertheless possess the same symmetries and 
synchronous solutions as the original network. We explain how to compute Lie brackets 
and normal forms of coupled cell networks and we characterize the SN-decomposition that 
determines the normal form symmetry. This paper concludes with a generalization to non- 
homogeneous networks with the structure of a semigroupoid. 

1 Introduction 

Coupled cell networks appear in many of the sciences and range from crystal models and 
electrical circuits to numerical discretization schemes, Josephson junction arrays, power 
grids, the world wide web, ecology, neural networks and systems biology. Not surprisingly, 
there exists an overwhelming amount of literature on coupled cell networks. 

The last decade has seen the development of an extensive mathematical theory of dy- 
namical systems with a network structure, cf [16], [24], [35], [IS]: [SI]- In these network 
dynamical systems, the evolution of the state of a constituent or "cell" is determined by the 
states of certain particular other cells. It is generally believed that a network structure has 
an impact on the behavior of a dynamical system, but it is not always clear how and why. 

As an example, let us mention a system of differential equations with a homogeneous 
coupled cell network structure of the form 

= f{xat(i),- ■ • for 1 < i < Af. (1.1) 

These differential equations generate a dynamical system in which the evolution of the 
variable Xi is only determined by the values of x„^(^i), . . . ,2; The functions 

ai,...,<7„:{l,...,iV}^{l,...,iV} 

can thus be thought of as a network that prescribes how which cells influence which cells. 

The literature on network dynamical systems focuses on the analysis of equilibria, peri- 
odic solutions, symmetry, synchrony, structural stability and bifurcations. As in the classical 
theory of dynamical systems, one often faces the task here of computing a local normal form 
near a dynamical equilibrium. These normal forms are obtained from coordinate transforma- 
tions, and in their computation one calculates Lie brackets of vector fields, either implicitly 
or explicitly. It is here that one encounters an important technical problem: 

Differential equations of the form in general do not form a Lie-algebra. 
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As a consequence one can not expect that the normal form of a coupled cell network is a 
coupled cell network as well. This complicates the local analysis and classification of network 
dynamical systems, because it means that one always has to compute the normal form of 
a network explicitly to understand its generic behavior - unless one is willing to assume 
that the network is given in normal form from the beginning, cf. [24], [29]. Normal form 
computations in [13], [21], [26] have revealed that a network structure can have a nontrivial 
impact on this generic behavior. One wants to understand and predict this. 

In this paper, we will formulate an easily verifiable condition on a network structure under 
which the coupled cell network vector fields do form a Lie subalgebra of the Lie algebra of 
vector fields. Our main result is the following: 

// {(Ti, . . . ,a„} is a semigroup, then the differential equations (1-lp form a Lie algebra. 
In this case, the local normal form of fl.H) is also of the form ifi.il) . 

In addition, we show that the Lie bracket of semigroup coupled cell network vector fields can 
be lifted to a symbolic bracket that only involves the function /. Normal form calculations 
can be performed at this symbolic level and one only returns to the reality of the differential 
equation when one is done computing. We also show that the symbolic space carries a 
dynamics of its own, determined by a certain fundamental network. 

This situation is analogous to that of Hamiltonian vector fields, of which the Lie bracket 
is determined by the Poisson bracket of Hamiltonian functions. As a consequence, Hamilto- 
nian normal forms are usually computed at the level of functions. Moreover, the symbolic 
dynamics of Hamiltonian functions is determined by a Poisson structure, cf. |41) . 

When CTi, . . . , (j„ do not form a semigroup, then we suggest that one simply completes 
them to the smallest collection 

ai, . . . ,a„,a„+i, . . . , cr„/ : {1, . . . , iV} {1, . . . , A^} 

that does form a semigroup under composition. Then (ll.lf) can be written as 

i« = f'i^aiii), ■ ■ ■ i^cT^^,(i)) with f'{Xi, . . . , X„,X„+i,. . . , := f{Xi,. . . , X„) . 

The normal form of (|l.l|l will now lie within the extended class of semigroup coupled cell 
networks, there being no guarantee that it is again of the original form (|l.ip . 

Thus one can choose: either to respect any given network structure as if it were a law of 
nature, so that no normal form can be computed, or to extend every network to a semigroup 
network and live with the consequences. One can object that even simple networks may need 
a lot of extension before they form a semigroup. But as an argument in favor of the semigroup 
approach, let us mention that the symmetries and synchrony spaces of a network are not at 
all affected by our semigroup extension. This implies in particular that these symmetries and 
synchrony spaces will also be present in the local normal form of the network. This latter 
property is both pleasant and important, if only in view of the large amount of research that 
has been devoted to symmetry [5], [B], [S], [H], [2S], [31] and synchrony P]. [5]. [3], [H], [TO]. 
[TT] . [27] . [32] . [34] . [58] . [49] . [51] . [53] in coupled cell networks. Semigroups may well be 
the natural invariants of coupled cell networks, even more than groups and symmetries. 

Normal forms are computed by applying coordinate transformations [32], [IS], [3S], |47| . 
These transformations can be in the phase space of a differential equation, but in our case 
they take place in the space of functions / and have the form of a series expansion 

/ ^ e"'"./ = ./ + ad^(/) + i(ad^)^(/) + . . . . 

Here / is the function to be transformed and normalized, g generates the coordinate trans- 
formation and ad^ denotes a representation, in this case the adjoint representation of the 
Lie algebra of f's. Although at first sight this may seem a needlessly complicated way to 
describe coordinate transformations, this "Lie formalism" allows for a very fiexible theory 
which streamlines both the theory and the computations. 

The actual computation of the normal form of the function /, and in particular the 
matter of solving homological equations, will not be entirely standard in the context of 
networks. Some things remain as in the theory of generic vector fields. For example, we 
show that the adjoint action of a linear element admits an SN-decomposition that determines 
a normal form symmetry. Other aspects may not carry through, such as the applicability 
of the Jacobson-Morozov lemma to characterize the complement of the image of the adjoint 
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action of a nilpotent element [7]. This is because the Lie algebra of the linear coupled cell 
network vector fields need not be reductive. 

This paper is organized as follows. After giving a formal definition of a homogeneous 
coupled cell network in Section [2J we show in Section [3] that semigroups arise naturally in 
the context of coupled cell networks. In Sections |4] and [5] we prove that semigroup network 
dynamical systems are closed under taking compositions and Lie brackets. Section[6]explains 
how to compute the normal form of a network dynamical system, while in Sections [7] and [H] 
we prove that this normal form inherits both the symmetries and the synchrony spaces of the 
original network. In Section |9] we investigate the SN-decomposition of a linear coupled cell 
network vector field. This decomposition determines the normal form symmetry. Section 
[To] describes the aforementioned fundamental network. In Section [11] we actually compute 
the normal forms of some simple but interesting coupled cell networks, thus demonstrating 
that a coupled cell network structure can force anomalous steady state bifurcations. Finally, 
we show in Section [12] that our theory is also applicable to non-homogeneous or "colored" 
networks that display the structure of a semigroupoid. 

Issues that we do not touch in this paper but aim to treat in subsequent work include: 

1. The development of a linear algebra of semigroup coupled cell systems in order to 
define for example a "semigroup network Jordan normal form". 

2. Application of the results in this paper to semigroup networks that arise in applications, 
such as feed-forward motifs. 

3. Understanding the impact of "input symmetries" on bifurcations and normal forms. 

2 Homogeneous coupled cell networks 

We shall be interested in dynamical systems with a coupled cell network structure. Such a 
structure can be determined in various ways [16], [35], [38], [51], but we choose to describe 
it here by means of a collection of distinct maps 

E = {ai,...,a„} with ai, . . . , cr„ : {1, . . . , iV} ^ {1, . . . , TV} . 

The collection E has the interpretation of a network with 1 < < oo cells. Indeed, it defines 
a directed multigraph with A'' vertices and precisely n arrows pointing into each vertex, where 
the arrows pointing towards vertex 1 < i < A emanate from the vertices ai{i), . . . , cr„{i). 
The number n of incoming arrows per vertex is sometimes called the valence of the network. 

In a network dynamical system we think of every vertex 1 < i < A in the network as a 
cell, of which the state is determined by a variable Xi that takes values in a vector space V. 

Definition 2.1 Let E = {tJi, . . . , be a collection of n distinct maps on N elements, V 
a finite dimensional real vector space and / : V" V & smooth function. Then we define 

-ff.V^^ by i^fUx) ~ . . . ,a;,„(,)) for 1 < i < iV. (2.2) 

Depending on the context, we will say that 7/ is a homogeneous coupled cell network map 
or a homogeneous coupled cell network vector field subject to E. A 

In the literature, 7/ is also called an admissible map/vector field for the network E. 

Dynamical systems with a coupled cell network structure arise when we iterate the map 
7/ or integrate the vector field that it defines. The iterative dynamics on has the 
special property that the state of cell i at time m+1 depends only on the states of the cells 
(Ti(i), . . . , o"„(i) at time m: 

x^'^+'^ = jfix'-"'^) if and only if xl"'+'^ = f{xi"^ly . . • for 1 < j < iV. (2.3) 

The continuous-time dynamical system on displays the same property infinitesimally: it 
is determined by the ordinary differential equations 

X = 'yf{x) if and only if Xi — . . . , Xcr^(i)) for 1 < i < TV. (2-4) 

We aim to understand how the network structure of 7/ impacts these dynamical systems. 
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Example 2.2 An example of a directed multigraph is shown in Figure[TJ where the number 
of cells is A*' = 3 and valence is equal to n = 2. The maps ai and a2 are given by 

cri(l) = l,ai(2) = 2,cri(3) = 3, 
Cr2(l) = 1,(72(2) = 1,(J2(3) =2. 



Xi 



Xi 



X2 



Xs 




X2 




X3 



Figure 1: The collection {cri,cr2} depicted as a directed multigraph. 



A coupled cell network map/vector field subject to {0-1,(72} is of the form 

'yf{xi,X2,X3) = (/(a;i,a;i),/(a;2,a;i),/(a;3,a;2)). (2.5) 

This network has obtained some attention [13], [24], [26], [29], [40] because it supports an 
anomalous codimension-one nilpotent double Hopf bifurcation when dim V — 2. A 

Example 2.3 In this example we let (7i,(72 be as in Example 12.21 and we also define (73 as 

(73(1) = 1,(73(2) = 1,(73(3) = 1. 
The network defined by {(71,(72,(73} is depicted in Figure [2] 
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Figure 2: The collection {(71,(72,(73} depicted as a directed multigraph. 

A coupled cell network map/vector field subject to {(71,(72,(73} has the form 

'yg{xi,X2,xz) = (5(xi,xi,xi),g(x2,xi,xi),g(x3,a;2,a;i)) . 

We remark that this example is a generalization of Example 12.21 if 7/ is as in Example 
and if we define g{Xi,X2,Xs) := /(Xi, X2), then 7g — 7/. In other words, (|2.5p arises as a 
special case of (|2.6p . A 



(2.6) 
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3 Semigroups 

A first and obvious difficulty that arises in tlie study of coupled cell network dynamical 
systems is that the composition 7/ o 7g of two coupled cell network maps with an identical 
network structure may not have that same network structure. 

Dynamically, this implies for example that the equation 7/ (a;) = x for the steady states 
of 7/ and the equation (7/)™'(a;) = x for its periodic solutions may have quite a different 
nature. We illustrate this phenomenon in the following example: 

Example 3.1 Again, let A*' = 3 and let (7i,CT2,o"3 be defined as in Examples 12.21 and 12.31 If 

-rf{xi,X2,X3) = (/(a::i,a::i),/(a;2,3;i),/(a;3,a;2)) , 
■yg{xi,X2,X3) = {g{xi, xi) , g{x2, xi) , g{x3, X2)) , 

are coupled cell network maps subject to {cti, 0-2}, then the composition 

(7/ ° 79)(a;i,a;2,a:3) = {f{g{xi, xi), g{xi, xi)), f{g{x2, xi), g{xi, xi)), f{g{x3, X2), g{x2, xi))) 

in general is not a coupled cell network map subject to {cti, (J2}. 

On the other hand, when 7/ and jg are network maps subject to {cti, (J2, 0-3}, i.e. 

7/(a::i,a::2,a::3) = {f{xi,Xi,Xi),f(x2,xi,xi),f{x3,X2,Xi)) , 
^g{xi,X2,X3) = {g{xi,xi,xi),g{x2,xi,xi),g{x3,X2,xi)) , 

then it holds that 

(7/ o7g)i(a;i,a;2,a;3) = f{g{xi, xi, xi), g{xi, xi, xi), g{xi, xi, xi) , 
(7/ o 79)2(3:1, a;2, 2:3) = f{g{x2, xi, xi), g{xi, xi, xi), g{xi, xi, xi)) , 
(7/ °79)3(a;i,a;2,a;3) = f{g{x3,X2,Xi),g{x2,Xi,Xi),g{xi,Xi,Xi))) . 

This demonstrates that 7/ o 73 is also a coupled cell network map subject to {cri, 0-2, 0-3}. 
Indeed, 7/ o 7^ — "fh, where 

h{Xi,X2,X3) = f(g{Xi,X2,X3),g{X2,X3,X3),g{X3,X3,X3)) . 

A 

To understand when, in general, the composition of two coupled cell network maps is again 
a coupled cell network map, we compute that 

(7/ °79)i(a;) = ,/■(■ • ■ , (79)<Tj(i)(a;),- • •) = .f{- ■ ., g{x^^(^„ . . . ,a;^„{^^.(i))),. . .) . (3.7) 

The right hand side of (|3.7|l is an i-independent function of (ar^^f^) a; „.„(;)) precisely 
when for all 1 < Ji,j2 < n and all 1 < i < A it holds that o-ji (o-jj (i)) = o-j^{i) for some 
i ^ j3 ^ n. In other words, 7/ o 7g is a coupled cell network map when E is a semigroup: 

Definition 3.2 We say that E — {ai, . . . ,a„} is a semigroup if for all 1 < ji, j2 < n there 
is a unique 1 < 73 < n such that aj^ o aj^ = aj^ . A 

Viewing E as a directed multigraph, the condition that it is a semigroup just means that 
this directed multigraph is closed under the backward concatenation of arrows. 

Of course, an arbitrary collection E = {tJi, . . . , a„} need not be a semigroup. Even so, 
E generates a unique smallest semigroup 

E' = {o"i , . . . , CT„, <Jn+i, . . . , o"n' } that coutaius E . 

It is clear that every coupled cell network map 7/ subject to E is also a coupled cell network 
map subject to the semigroup E'. Indeed, if we define 

f'i^^J • ■ • , ^ri, Xn+l, . . . , X„i) :— f{Xl, . . . , Xn) 

then it obviously holds that 

{'yf')i{x) = /'(a;^j(,), . . . ,a;^„(i),a;^^^j(i), . . .,x„^,^,)) = f{x„^(i),. . .,x^^(,)) = {'yf)t{x) . 

We thus propose to augment E to the semigroup E' and to think of every coupled cell 
network map subject to E as a (special case of a) coupled cell network map subject to E'. 
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Example 3.3 Again, let A'^ = 3 and let cri, 0-2,0-3 be defined as in Examples 12.21 and 12.31 It 
holds that of = 03, so the collection {0-1,02} is not a semigroup. On the other hand, one 
quickly computes that the composition table of {0-1,02,0-3} is given by 
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0-3 


0-2 


0-2 
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0-3 


0-3 


0-3 


0-3 


0-3 



This shows that {ai, 02, 0-3} is closed under composition and hence is the smallest semigroup 
containing {ai, 02}. A 

4 Composition of network maps 

To understand better ho-w network maps behave under composition and in order to simplify 
our notation, let us define the maps 

TTi : -J> V'^ by 7ri(a;i, . . . ,xn) {x^^(i), . . . ,a;^,^(i)) for 1 < i < iV . 

This definition allows us to write (|2.2p simply as 

ilfh-foTTi. (4.8) 

Expression (|3.7|) moreover turns into the formula 

(7/ ° ls)i ^ f°{9° 7r<Ti{«) X ... X 3 o 7r^„(i)) . (4.9) 



The following technical result helps us write the right hand side of (|4.9|l in the form h o m 
for some function h : V" V, whenever E is a semigroup. 

Theorem 4.1 Let E — {ai, . . . , o„} be a semigroup. Then for all 1 < j < n there exists a 
linear map Ac- : V" — )■ V" with the property that 

Aa- o m = T^a-ii) for all 1 < i < N and all 1 < j < n . (4.10) 
Moreover, it holds that Acr-_^ o Ac,.^ — Ac-^oaj^ for all 1 < j\,j2 < n. 
Proof: Because E is a semigroup, we can associate to each map Oj G E a unique map 

Oj : {1, . . . , n} — >■ {1, . . . , n} defined via the formula (^B^{k) = Oj o au ■ (4-11) 
We now define the map A^^ : l^" — s> V" as 

^.,(Ai,...,A„) := (X5,y),...,A5„(,)). (4.12) 
With this definition it holds that 

{Aa^ o'K^){x) = A<^^.(a;„j(i), . . . ,a;^„{,)) = (aj^^^^j (i) , . . . , a;^^^^ (;)) 
= (a;<Ti(<Tj{,)), ■ • ■ ,a;<T„(CTj(i))) = 7r^^.(,)(a;) . 

Remarking moreover that 

'^55^Ul)02) = '^S/cOl) ° '^32 ^^kO 0-ji O Oj2 = Ofe O CT^.^^j^^ = CT^fc (Sji (j2 )) ' 

and hence that o^d-^(ji){j2) ~ c7k(S^ji (J2)) for all 1 < fc < 71, we also find that 
(^"ji ° -4<Tj2)(A:i, . . . ,X„) = A„^^ {Xs^(j^),. . .,Xs^(j^)) = {Xs^^^.^^(j^), . . . ,Xj^^^.^^(j^)) 

This proves the theorem. □ 

The identity Ao-j^ o A^j^ = Acrj^oaj^ expresses that the Aa^ form a representation of the 
semigroup E. Using this representation we obtain: 
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Theorem 4.2 Let E — {ai, . . . ,(7„} be a semigroup. Define for f,g : V" V the function 
fosg:V"^Vbyfosg~fo({go A.,) X . . . X (g o A^J) . (4.13) 

Then 

Proof: From formula (|4.9p and Theorem 14. II □ 

Theorem 14.21 reveals once more that if E is a semigroup, then the composition of two coupled 
cell network maps 7/ and 7^ is again a coupled cell network map, namely 7/029- More 
importantly, it shows how to compute f g "symbolically" , i.e. using only the functions / 
and g and a representation of the network semigroup. 

The final result of this section ensures that the "symbolic composition" makes the 
space C°°(y", V) into an associative algebra. 
Lemma 4.3 

(/ °T.g)oT.h = f OE {g OE h) . 

Proof: 

if OE g) OS h{X) = (/ OS . . , h{A^,X), ...) = /(..., g{A^^ (. . . , . . .)), . . .) = 

/(. . . . , ...) = /(...,<;(..., /i(A.,o.,X), . . .) = 

/(...,<;(..., hiA,,A,^X), ...),...) = /(...,(<; h)iA,^X), ...) = / (g . 

□ 

With Lemma 14.31 at hand. Theorem 14.21 just means that the linear map 
7 : C°°iV", V) ^ C°°{V^, V^) that sends / to 7/ 
is a homomorphism of associative algebras. 

Example 4.4 Again, let A'^ = 3 and let ai,a2,a'3 be defined as in Examples 12.21 and 12.31 
We recall that the composition table of {cri, (72, era} was given in Example 13.31 The rows of 
this table express that 

ai(l) = l,5i(2) = 2,5i(3) =3, 
a2(l) = 2,52(2) = 3,52(3) =3, 
53(1) =3,53(2) = 3,53(3) =3. 
This implies in particular that 

(-^1 , X2 , X3 ) = {Xl , X2 , X3 ) , 
^a2(-^l, A2,X3) = {X2, X3, X3) , 
Ac,^{Xl, X2, X3) — {X3, X3, X3) . 

Substitution in (|4.13|) therefore yields that 

fosg{X,,X2,X3)^f{g{Xi,X2,X3),g{X2,X3,X3),g{X3,X3,X3)). 
We conclude that / g equals the function h found in Example 13.11 A 
Remark 4.5 The defining relation 

o"5j (fe) = o-j ° cTfc for 5j : {1, . . . , n} ^> {1, . . . , n} 
expresses that the map 5j describes the left- multiplicative behavior of aj . The computation 

'^a.^j.Cfe) = ^Jl ° <^32 ° CTfc = CTjl ° ^if.^ik) = (^S,-, (S^^ (fc)) 

moreover reveals that 

""ii ° '^32 ~ ^ji ° ^32 fo'^ 1 ^ ii J ia < w . 

This means in particular that the collection {5i, . . . ,5„} is closed under composition. 

The maps 5i, . . . ,5„ will play an interesting role in this paper. In fact, we will show in 
Section [TO] that they are themselves the network maps of a certain "fundamental network" 
that fully determines the fate of all network dynamical systems subject to E. A 
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Remark 4.6 For a map a : {1, . . . , n} — > {1, . . . , m} let us denote by : V™ —>■ V" the 
linear map 

Xa-{Xl, . . . , Xm.) '■= (-'f(T{l) I • • • J X^(„-i ) . 

This means that the matrix of the map has precisely one idv on each row and zeroes 
elsewhere. We will denote the space of such maps by 

A(m,n) := {A„ : V"" ^ V"\a: {l,...,n} {l,...,m}} . 

One quickly checks that the assignment A : ct i— !■ A^ is contravariant. More precisely, if 
a : {1, . . . , n} — >■ {1, . . . , m} and r : {1, . . . , m} — s- {1, . . . , /}, then 

Act O At = Xrocr ■ 

In particular, A(m, m) is a semigroup and the map cr i-^ Ao- an anti-homomorphism from the 
semigroup of all maps from {1, . . . , m} to itself to the semigroup A(m, m). 
The maps tt; and A^^ defined above are examples of such maps: 

TTi —X^i with cr' : {1, . . . ,n} ^ {1, . . . , A''} defined as cr'{j) :— cTj{i) . 
A^- =X~j with CT^ : {1, . . . ,n} -> {1, . . . ,n} defined by a^(fc) := afe(j) . 

This observation can be used give a proof of Theorem 14. II that is free of coordinates: 
Proof [Of Theorem [4711 without coordinates]: We observe that 

a{y{k)) = a{ak{j)) = craffeU)(«) = {(Jk o = afe(crj(j)) = a''^'-'\k) 

and hence that cr' o a-' = a'^j'^'''. Using this, we find that 

A„^ o TTi = A53 o A^i = A„,o53 = '^^■'jCO = ^T-id) ■ 
Similarly, the computation 

'^{5J2o£fJl)(fe) = f^5j2(5Jl(fc)) = '^532(5j^(ji)) = '^55fcUi)(i2) 

reveals that 

As a consequence, 

□ 

Unfortunately, this coordinate free proof of Theorem 14. II is relatively long. A 

5 A coupled cell network bracket 

We will now think of 7/ : V'^ ^ as a vector field that generates the differential equation 

i = -yfix) . 

We suggestively denote by e'"^^ the time-t fiow of the vector field 7/ on V'^ and by (e''*''' )t7/ 
the pushforward of the vector field 7/ under the time-t fiow of 73. We recall that the Lie 
bracket of 7/ and 7g is then the vector field [7/579] : V^'^ defined as 



= Djfix) ■ 79 (x) - D-/,{x) ■ 7/(x) . (5.14) 



The main result of this section is that if E is a semigroup, then the collection of coupled cell 
network vector fields is closed under taking Lie brackets. 
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Theorem 5.1 Let S — {ai, . . . ,(t„} be a sermgroup and let the A^. : 1/" V" be as in 
Theorem IJH] Define, for /, g : V" — )• V, the function [/,p]e : V" ^ V by 

n 

[/,5]s := • (5 ° ^-.) - Djg ■ if o A^^) . (5.15) 

Then 

bfy-yg] = 7[/,9]s ■ (5-16) 

Proof: We start by remarking that 

lf{x + tjg{x)), = /(. . .,x^^(i) +t79(a;)^.(i), . . .) = 

/(..., x^.^i-, + ig(a;^j(CT^.(i)), . . . ,a;CT„(CT^(i))), • • •) = 

/(..., a;^^(i) + {Xai(x) , • • • , a;<T„(i))), • • •) • 

DifFerentiating this identity with respect to t and evaluating the result at t = gives that 

n 



This proves that (-D7/ ■ 7g)i = (^X]j=i -^i/ ' (ff ° ° '"'m ''■iid hence that 1)7/ ■ 79 is a 

coupled cell network vector field. With a similar computation for D"fg 7/, we thus find that 
the Lie bracket between 7/ and 7g is given by 

n 

[lf,^a\i = {D'yf^g)t-{D-ig-if), =^ [Djf ■ {goAa^) ~Djg- (/ o A<,J] ott, = [f,g]T.o'Ki. 

This proves the theorem. □ 

Lemma 15.21 below states that the "symbolic bracket" [■, -Je is a Lie bracket. 

Lemma 5.2 The bracket [■, -Je makes C°°{y^,V) a Lie algebra. Moreover, the linear map 

7 : C°°(y", V) — > C°°(V^, V^) t/iat sends f to "ff is a Lie algebra homomorphism. 

Proof: Anti-symmetry of [■, -Je is clear from formula (|5.15|l . The Jacobi identity 

[/, [5, h]^]^ + [g, [h, /]e]e + [h, [/, 5]e]e = 
follows from a somewhat lengthy computation as follows. First of all, because 

A,^ {..., h{A^,X), ...) = (..., ...) = (..., h{A^,A^^X), ...), 

we find that 

{goA^^){X + t(..., h{A^,X), ...)) = g(A^^X + tA^^ (..., h{A^,X), . . .)) 
= g{A^^X + t{...,h{A^,A^^X),...)). 

Differentiating this identity with respect to t and evaluating the result at t = yields that 

n n 

Y^DkigoAa^) ■ {hoAa^) = Y^{DkgoA^^) ■ {hoA^^oA^^). 
fc=i fe=i 

With this in mind, we now compute that 

= 2^ J fe^i ■ (^'=5' ° ^-,) ■ ° A'^k Djf ■ {Dkh o A„.) ■ {g o A„^ o A„^) 

~Dkg ■ D, {h oA^,)-{foA„.) + Dkh- D, {g o A, J ■ (/ o A,^ ) 
-Dlkg- {ho A^^J o A^^) + Dl^h- {go A^^J o A^/) 

En 
. Dkf ■ D, {g oA„,)-{hoA„^)~Dkf- D, {h oA^,)-{go A„^ ) 

~Dkg ■ Dj {h o A, J . (/ o A,^ ) + DkhD,{go A„, ) ■ (/ o A^^ ) 
-Dly,g -{hoA^^Jo A^^ ) + Dlkh ■ {g o A^^ JoA^^). 
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Using the symmetry of the second derivatives, the Jacobi identity follows from cyclically 
permuting /, g and h in the above expression and summing the results. This proves that 
C°°(V", V) is a Lie algebra. Theorem 15 . 1 1 means that 7 is a Lie algebra homomorphism. □ 

Example 5.3 Again, let A'' = 3 and let (Ti,(T2,(T3 be defined as in Examples 12.21 and 12.31 
We recall that Ac^^,Acr2 and Ao-g were computed in Example 14.41 It follows that 

[f,g]s(X) = D^fiX^,X2,X3) ■ g(X^,X2,X3) + D2fiX^,X2,X3) ■ g(X2,X3,X;) 

+ D3 / ( Ai , X2 , X3 ) • 3 (X3 , X3 , X3 ) - Di (Xi , A2 , A3 ) ■ / ( Xi , X2 , X3 ) 
- D2r?(Ai , A2 , A3) ■ /(A2 , A3, A3) - D3ff (Ai , A2 , A3) ■ /(A3 , A3, A3) . 

A 

6 Coupled cell network normal forms 

Normal forms are an essential tool in the study of the dynamics and bifurcations of maps and 
vector fields near equilibria, cf. [42], [47]. In this section we will show that it can be arranged 
that the normal form of a semigroup coupled cell network is a coupled cell network as well. 
This normal form can moreover be computed "symbolically", i.e. at the level of the function 
/. With Theorem 15. II at hand, this result is perhaps to be expected. We nevertheless state 
two illustrative theorems in this section, and sketch their proofs. 

We start by making a few standard definitions. First of all, we define for / £ C°° {V" , V) 
the operator a.df : C°°(V", V) C°°{V", V) by 

ad/ (3) — [/,ff]s . 

Next, we define for every fc = 0, 1, 2, . . . the finite dimensional subspace 

:= {/ : V" V homogeneous polynomial of degree fc + 1 } C C°°{V", V) . (6.17) 

One can observe that = L{V^ , V) and that if / G P'' and g G P' , then [f,g]s e P^+\ 
as is obvious from formula (|5.15p . In particular, we have that 

if ,fo G V) then ad^„ : P'' P^ . 

With this in mind, we formulate the first main result of this section. It essentially states 
that one may restrict the study of semigroup coupled cell networks near local equilibria to 
semigroup coupled cell networks of a very specific "normal form" . 

Theorem 6.1 (Coupled cell network normal form theorem) Let E = {ai,...,(T„} 

be a semigroup, f G C°° {V" ,V) and assume that /(O) = 0. We Taylor expand f as 

/ = /o + /l + /2 + . . . With fk GP'' . 

Let 1 < r < 00 and for every 1 < k < r , let N'' C be a subspace such that 

N'' e im ad5„ j = P\ 

Then there exists an analytic diffeomorphism $, sending an open neighborhood of m 

to an open neighborhood of in , that conjugates the coupled cell network vector field 7/ 

to a coupled cell network vector field 7j with 

7 = /o + 7i + 72 + . . . andJi^e N'' for all 1 < k < r . 

Proof: [Sketch] We only sketch a proof without estimates here, because the construction 
of a normal form by means of "Lie transformations" is very well-known. 

For g G C°°{V", V) with g{0) = 0, the time-t flow e'^" defines a diffeomorphism of some 
open neighborhood of in to another open neig hborhood of in V'^. Thus we can 
consider, for any / G C'^{V",V), the curve t (e*i''').7/ G C°°{V'^,V'^) of pushforward 
vector fields. This curve satisfies the linear differential equation 

(e''-<'),((e*--').7/) = [l„ (e'^')*7/] = ad,, ((e*-«).7/) , (6.18) 

h = 



dt^ 



*7/ 



d_ 

dh 
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where the second equahty holds by definition of the Lie bracket of vector fields (|5.14|l and 
we have used the conventional definition of ad^, : C°°(V"^, V^) ^ C°°{V'^, V'^) as 

ad7g(7/) := [79,7/] • 

Solving the linear differential equation (|6.18|) together with the initial condition (e''^'')*7/ = 
7/, we find that the time-1 flow of 7^ transforms 7/ into 

(e^").!/ = e'"^'"'{lf) = 7/ + [79,7/] + ^[79, [79,7/]] + ■ •• • 
The main point of this proof is that by Theorem 15. II the latter expression is also equal to 

'>/+[9,/1e + ^[9.[9,/]e1i: + .-.^'>',=iS^^j. 

The diffeomorphism $ in the statement of the theorem is now constructed as the composition 
of a sequence of time-1 flows e''^k (1 < fc < r) of coupled cell network vector fields 73^, with 
Qk £ P''- We first take gi G P^, so that 7/ is transformed by e"*""! into 

(e^«i ).7/ = 7,ad,, = 7/0+/1+/1 + ... 

in which 

A' = /i + [5i,/o]e GP^ 
/I = /2 + [51, /i]e + |[<7i, [91, /o]e]e G 
/I = /3 + • • • G P3 

etc. 

It is the fact that A'^^ © im ad^^^ — that allows us to choose a (not necessarily unique) 
gi G P^ in such a way that 

fl = /i + [<7i, /o]e = /i - ad^„ (<7i) G . 

We proceed by choosing g2 G P^ in such a way that (e^f^ o e^^i = (6^32 )^((eT9i ),7y) = 
'^/o+/J +/! + ■• ■ /a £ -'V^- Continuing in this way, after r steps we obtain that 

<E> ~ e^"'^ o . . . o e^''! 

transforms 7/ into <1'»7/ ~ ~ 7/^+/^+ where /j. = G A^'' for all 1 < fc < r. 

Being the composition of flnitely many flows of polynomial coupled cell network vector 
fields, "1? is obviously analytic. □ 

In applications, one is often interested in the bifurcations that occur in the dynamics of 
a map or differential equation under the variation of external parameters. In the case of 
coupled cell networks, we may for example assume that / G C°°(l/" x W , V) and let 

f\X):^ f{X-\) 

define a smooth parameter family in C°°{V", V). Correspondingly, the coupled cell networks 
7J^A form a smooth parameter family in C°°(V^, V^^). 

To formulate an appropriate normal form theorem for parameter families of coupled cell 
networks, we define for k > —1 and I > 0, 

P*'' := {/ : y" X R'' — >■ V homogeneous polynomial of degree fe + 1 in X and degree Z in A} . 
We observe that 

which leads to the following 

Theorem 6.2 (Coupled cell network normal form theorem with parameters) Let 

E = {o-i, . . . , cr„} he a semigroup, f G C°° {V" x R*", V) and /(O; 0) = 0. We Taylor expand 

f = (/_i,i + f-1,2 + ...) + (/o,o + /o,i + /o,2 + ...) + (/i,o + .fi,i + /i,2 + ...) + ... 
with fk,i G P''''. 
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Let 1 < ri,r2 < oo and for every — 1 < fc < ri and < I < r2, let N''-^ C P*'' be a 
subspace such that 

iV*-' © im ad5„ J =P*^ 

1 pk.l 

Then there exists a polynomial family of analytic diffeomorphisms, defined for X in an 
open neighborhood of in W and each sending an open neighborhood of m to an open 
neighborhood of m , with the property that $^ conjugates 7ja to 7ja , where 

7 = (7_i,i + 7.1,2 + ■•■) + (/o.o + 7o,i + 7o,2 + ■••) + (7i,o + 7i.i + 7i,2 + •••) + ■■• 

and 

Jk,i e A^*"'' for all - 1 < fc < ri and < I < r2 . 

Proof: [Sketch] The procedure of normalization is similar as in the proof of Theorem 16.11 
With respect to ad^^^ ^ , one consecutively normalizes 

/i.o, /2.0, • • • , /ri.o; /-l.l, /o.i, /l.l, . ■ . , /ri.i; 

./-1. 2, ./0.2, ,fl,2, . . • , /ri.2; • • • ;/-l,r2) /o.ra i /l.ra ) • • ■ i fri.r^ ■ 

Because [P*'',P^'^]e C p'=+^.'+^^ we see that once fkj has been normalized to f,. it is 
not changed/affected anymore by any of the subsequent normalization transformations. □ 

Of course, Theorem l5.ll implies that many other standard results from the theory of normal 
forms will have a counterpart in the context of semigroup coupled cell networks as well. 
We will compute the normal forms of some network differential equations in Section [TT] 

Example 6.3 Again, let A'^ = 3 and let ai, 0-2, era be defined as in Examples 12.21 and 12.31 If 

7/(xi,X2,X3) = {f{xi,Xi),f{x2,Xi),f{x3,X2)) 

is a coupled cell network subject to {ai,(T2}, then its normal form will in general be a 
network subject to {cri, (T2, era}, i.e. 

JJ(X1,X2, X3) = "/j(xi,X2, X3) = {f{xi,Xl,Xl), f{x2,Xl,Xl),f{x3, X2, Xl)) . 

A 

7 Symmetry and synchrony 

Symmetry [5], [6], [E], [25], [31] and synchrony [2], [3],[l0], [TT], [2Z], [32], [34], [38], [49], 
[51j . [53j have obtained much attention in the literature on coupled cell networks. They 
generate and explain interesting patterns, including synchronized states f30l, multirythms 
[19j . [36], [44], [52], rotating waves [24], [32] and synchronized chaos ^20^, ^24j and can lead 
to symmetry and synchrony breaking bifurcations, cf. [T], [4], [8], [9], [14], [15], [T7], [22| . 
[25] . [31| . [33| . [43| . [50| . In short, symmetry and synchrony heavily impact the dynamics 
and bifurcations of a network. 

In this section, we relate some of the existing theory on symmetry and synchrony to the 
semigroup extension that we propose. More precisely, we show that the semigroup extension 
does not affect the symmetries or synchrony spaces of a network. This implies in particular 
that the symmetries and synchrony spaces of a network are also present its normal form. 
The semigroup extension is thus quite harmless and very natural. 

To start, let us say that a permutation p : {1, . . . , A*'} — >■ {1, .... A''} of the cells is a 
network symmetry for E if it sends the inputs of a cell to the inputs of its image. That is, if 

p o aj — Gj o p for all 1 < j < n . 

The permutations with this property obviously form a group. More importantly, they are 
of dynamical interest because the corresponding representations 

Ap : -> , {xi,...,xn) ^ . . . ,a;p(Ar)) 
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conjugate every coupled cell network map 7/ to itself: 

/(a;ai{p{,)),...,a;<,„(p(i)) = /(vrp(i)(x)) = (7/(a;))p(») = (Ap o 7^)^(0;) . 

In turn, this means that when t h-> {xi{t), . . . ,a;jv(t)) is a solution to the differential equa- 
tions X = 7/(a;), then so is t i-^ . . . , a;p(jv) (t)). And similarly that when m 1-^ 
{x^™\ . . . ,x^^^) is an orbit of the map a;'-'"^"'"' = 7/(3:^"'''), then so is m 1— > (a;^™), • • • ,x^^^^). 

The following lemma states that network symmetries are trivially preserved by our semi- 
group extension: 

Lemma 7.1 Let E = {cti, . . . ,a„} be a collection of maps, not necessarily forming a semi- 
group, and p : {1, . . . , N} — >■ {1, . . . , TV} a permutation. 

Then p is a network symmetry for E if and only if it is a network symmetry for the 
semigroup E' generated by E. 

Proof: Elements of the semigroup E' are of the form aj^ o . . . o o-j, for certain aj^. £ E. 
But if p o (jjj, = (Tjj. o p for k — 1, . . . ,1, then also p o (aj^ o . . . o o-j, ) = {aj-^ o . . . o aj, ) o p. 
Thus, the collection of network symmetries of E is the same as the collection of network 
symmetries of E'. □ 

Lemma |7. II implies in particular that the composition "ff o fg — 7/0^9 a^nd the Lie bracket 
[7/179] = 7[/,9]i; "^iU exhibit the same network symmetries as 7/ and 7g. 

Though not much more complicated, the situation is slightly more interesting for the 
synchronous solutions of a network. We recall that a synchrony space of a coupled cell 
network is an invariant subspace in which certain of the Xi (with 1 < i < N) are equal. First 
of all, the following result is classical, see [24], [49] . 

Proposition 7.2 Let E — {tJi, . . . , (t„} be a collection of maps, not necessarily forming a 
semigroup, and P = {Pi, . . . , Pr} a partition of {1, . . . , A*'}. The following are equivalent: 

1) For all 1 < j < n and all 1 < ki < r there exists a 1 < k2 < r so that cyj{Pk-^) C Pk2 ■ 

2) For every f G C'^{V",V) the subspace 

SyUp := {x £ I = Xi2 when i\ and 12 are in the same element of P } 
is an invariant submanifold for the dynamics ofjf. 

Proof: The subspace Syiip is invariant under the flow of the differential equation x = 7/(2;) 
if and only if the vector fleld 7/ is tangent to SyUp. Similarly, SyUp is invariant under the 
map x'™'^^' = 7/(a;'''"') if and only if 7/ sends SyUp to itself. Both properties just mean 
that for all x G SyUp it holds that 

f{xai{ii),- ■ ■,x^^(n)) = ./"(^<Ti{i2)i • • ■'^T„(i2)) for aU ii,i2 in the same element of P . 

The latter statement holds for all / G C^iV", V) if and only if for all x G SyUp, 

^tTj(ii) = 2;CTj{i2) for all 1 < J < n and all ii,i2 in the same element of P . 

It is not hard to see that this is true precisely when all CTj G E map the elements of P into 
elements of P. □ 

A partition P of {1,...,A'^} with property i) is sometimes called a balanced partition or 
balanced coloring and a subspace SyUp satisfying property ii) a, (robust) synchrony space. 

The following result says that the synchrony spaces of a network do not change if one 
extends the network architecture to a semigroup: 

Lemma 7.3 Let E = {ai, . . . , a„} be a collection of maps, not necessarily forming a semi- 
group, and P = {Pi , . . . , Pr} a partition of {1, . . . , A''}. 

Then SyUp is a (robust) synchrony space for E if and only if it is a (robust) synchrony 
space for the semigroup E' generated by E. 
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Proof: Elements of the semigroup E' are of the form aj-^ o . . . o aj^ for certain aj,, £ E. 
This imphes that the elements of E send the elements of P inside elements of P if and only 
if the elements of E' do. In other words: that the collection of balanced partitions of E and 
of E' are the same. The result now follows from Proposition 17.21 □ 

Lemma 17.31 implies in particular that the composition 7/ 07^ = Ifoj^g and the Lie bracket 
[7/1 79] = 7[/,9]s exhibit the same synchrony spaces as 7/ and 7g. 

We conclude this section with the following simple but important observation: 

Corollary 7.4 Let E = {cri, . . . , (t„} be a collection of maps, not necessanly forming a 
semigroup, and-jf a coupled cell network vector field subject to E. 

Then a local normal form yj of 7/ has the same network symmetries and the same 
synchrony spaces as jf. 

Proof: 7j is a coupled cell network with respect to the semigroup E' generated by E. 
Thus, the result follows from Lemma [7. II and Lemma 17.31 □ 

Example 7.5 Again, let A'' = 3 and let ai, 0-2,0-3 be defined as in Examples 12.21 and 12.31 
Recall that a coupled cell network differential equation subject to {ai, 02} is of the form 

ii = f{xi,Xi), ±2 = f{x2,Xi), ±3 = f{x3,X2) ■ 

These equations do not have any network symmetries, but they do admit the nontrivial 
balanced partitions 

{1,2}U{3} and {1,2,3}. 

The corresponding invariant synchrony spaces {xi = X2} and {xi — X2 ~ X3} are preserved 
in the normal form, because the latter is a coupled cell network subject to {01,0-2,0-3}. A 

8 Input symmetries 

In several of the coupled cell networks that appear in the mathematical literature, the 
function / that determines the network dynamics is assumed invariant under the permutation 
of some of its inputs. In this section, we point out some conditions under which such an 
input symmetry can be preserved in the normal form of /. This section is not important for 
the remainder of this paper and can be skipped at first reading. 

An input symmetry is reflected by a permutation q : {1, . . . ,n} {1, . . . , n} with the 
property that / o A, o vr^ — f oth for all 1 < i < A. That is, for which 

/(2:<7i(i), • • • ,a;<T„(i)) = /(a;<T,(i)(i), • • • ,a;a,(„,(o) for all x e V"^ and aU 1 < i < A . (8.19) 

The input symmetries of / obviously form a group. 

We do not aim here to give a full answer to the question under which conditions the 
invariance 1)8. 19p can be preserved in a normal form, because this question is very delicate. 
The first problem is that the presence of an input symmetry makes that the maps 01 , . . . , o-„ 
are not uniquely determined. A second complication is that an input symmetry of / has a 
nontrivial impact on its robust synchrony spaces. 

Instead, we will only consider the case here that an input symmetry gives rise to a 
network symmetry. This means that along with the permutation q of the inputs {1, . . . ,n} 
there exists a permutation p of the cells {1, . . . , A} that sends the j-ih input of each cell to 
the q(j)-th input of its image, i.e. that 

po Gj — o-q(j) o p for all 1 < j < n . (8.20) 

We call a permutation q for which there exists a permutation p so that (|8.19p and (|8.20|) hold 
a dynamical input symmetry. We remark that if pi ooj — Uq-^^{j) opi and p2 ooj = (Jq^d) °P2 
for all 1 < j < n, then 

(Pl OP2) OOj = O(,joq2)(j) ° (Pl °P2) . 

This implies that the dynamical input symmetries form a subgroup of the group of all 
input symmetries. They are precisely the input symmetries that correspond to a dynamical 
symmetry of the network: 
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Proposition 8.1 Let p he a permutation of {1, ... , N} and q a permutation of {1, . . . , n}. 

Assume that po Oj — (Jq(j) o p for all 1 < j < n and that S8.19\) holds. Then 

If o \p = XpO-yf . 

Proof: First of all we claim that 

when po aj — (Tq^j) o p for all 1 < j < n then vTi o Ap = A, o TTp^;) for all 1 < i < A'' . (8.21) 
This follows from a little computation: 

{'^x°\){x) = 7ri(j:p(i), . . . ,Xp(]^)) = (a::p(„j(i)), . . . , a::p{a„(i))) = 
(^'^5(i){p{0)' • ■ • '^t^gc^jbCi))) ^ \{x^^^p^i)), . . . ,a;CT„(p(i))) = (Aq o TXpi^i)){x) . 
Using (|8.2H) and our assumption (|8.19|) that f o — f on every im tt; , we hence find that 

(7/ ° >'p)^ = / O TTi O Ap = / O A, O 7rp(,) = / O 7rp(i) = (7/)p(i) = (Ap O 7y^), . 

□ 

The relevance of dynamical input symmetries for normal forms is explained below. We first 
show that dynamical input symmetries survive the semigroup extension. 

Lemma 8.2 Let E = {cti, . . . , a„} be a collection of maps, not necessarily forming a semi- 
group and let q : {1, . . . , n} {1, . . . , n} be a dynamical input symmetry for S. 
Then the latter extends to a unique dynamical input symmetry 

g':{l,...,n,n+l,...,n'}— >-{l,...,n,n + l,...,n'} 

for the semigroup E' = . . . , (j„, (J„+i, . . . , o"„'} generated by E. 

Proof: Recall that elements of E' are of the form aj^ o . . .oaj^ for certain aj^ € E. Assume 
now that p o aj^ = '^q(ji) ° P ^^'^ P ° ^12 ~ ^q{j2) ° P- Then it follows that 

P°^3j^U2) =P°{<^n °crj2) = °P°cri2 = ° <^qU2)) °P = '^5<,ui)(<j(i2)) °P- 

This means that if an extension q' : {1, . . . , n, n+ 1, . . . , n'} — )■ {1, . . . , n, n+ 1, . . . , n'} exists, 
then it must be unique and satisfy 

If now p o (Tj3 = <^q(j3) ° p and p o aj^ — cyq(j^) ° p and aj^ (72) — C7j^ (ji), then actually 

'^5<,(,1)(9(J2)) °P = P°f^5,i(j2) =P°'^5,3(J4) = '^5,03){904)) °P- 

From this it follows that (5(72)) — ^q(j3){Q{j4,)) if 5jj(j2) = 0^33^4) and hence that g' 

is well-defined. □ 

The following result explains that network symmetries are preserved under taking composi- 
tions and Lie brackets: 

Theorem 8.3 Let E be a semigroup and assume po Oj — (Jq{j) o p for all 1 < j < n. Then 

(/ °s p) o A, = (/ o A,) OS (3 o Ag) on every irrnv, , ,g ^g-j 

[/, g]E o A, = [/ o Ag,g o A,]e on every irmv^ . 

Proof: With slight abuse of notation, we write 

(/ °S g)oXqO 7rp(,) = /(. . . , g{Aaj oXqO 7rp(i)), . . .) = /(. . . , g{A^j O TTi O Ap), . . .) = 

/(. . . ,5(7r„^.(i) O Ap),. . .) = /(. . .,g{Xq O 7rp(„^. (,))),. . .) = /(. . . , (5 O Aq)(7rp(^. (;))), . . .) = 

/(..., (g o Ag)(7r„_^yj(p(i))), ...) = (/ o Xq){. ..,{go A,)(7r^ .(p(i))), . . .) = 

(/ ° \){- ■■,{g° o 7rp(,)), . . .) = ((/ o Xq) OS {g o A,)) o 7rp(,) . 

This proves that (/ os g) o Xq — {f o Xq) os {g o Xq) on each imvrpji) and hence, because p is 
invertible, on each imvTi. The proof for the Lie bracket is similar. □ 

Finally, we conclude 
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Corollary 8.4 Let E = {ai, . . . , (7„} be a collection of maps, not necessanly forming a 
semigroup, and 7/ a coupled cell network vector field subject to E. 

Then the local normal form yj of 7/ can be chosen to have the same dynamical input 
symmetries as jf. 

Proof: Let G denote the group of dynamical input symmetries of / = /o + /i + /2 + • • • 
and let us define the set of G-invariant functions 

Cg{V"',V) ■- {g e C°°{V", 1/) I p o A, o TTi = p o TTi for ah g G G and ah 1 < i < TV} . 

Theorem lO implies that ii g,he C'g{V", V), then also 

[g,hU€C^iV",V). 

The fact that / G Ca{V", V) moreover implies that 

fk G Pa ~ {gk G P'' \ gk o Xq o m = gk o m for all g G G and all 1 < i < A^} 

is a G-invariant polynomial of degree k + 1. 

It clearly holds that [Pa, Pah C As a consequence, we can repeat the proof of 

Theorem 16. II by replacing by Pq and choosing the normal form spaces 

No C Pg so that 

im ad/o \pk ® Nq = Pg ■ 
This produces a normal form J e Cg{V",V). □ 
Example 8.5 Consider the class of differential equations of the form 

±1 = f{xi,X2,X2,Xi) , 
±2 = f{xi,X2,Xi,X2) . 

These differential equations have a semigroup coupled cell network structure with N = 2 
and n — 4, see Figure [31 




Figure 3: The network with N = 2 and n = 4. 

The semigroup E in this case is the full non-Abelian semigroup of maps on 2 symbols. In 
other words, E — {o"i, (72, o"3, o"4}, where 

cri(l) = l,ai(2) = 1,^2(1) = 2,(72(2) = 2,(73(1) = 2,(73(2) = 1,(74(1) = 1,(74(2) = 2. 

There is only one nontrivial permutation p : {1, 2} — >■ {1, 2} of the cells, which is defined by 
p{l) :— 2 and p(2) := 1. It is easily checked that 

P O (7l = (72 O p, p O (72 = (7l O p, p O (73 = (73 O p, p O (74 = (74 O p . 

In other words, po Oj — o-q(j) o p if we let q : {1, 2, 3, 4} — s- {1, 2, 3, 4} be defined by 

q{l) = 2,q{2) = l,q{3) = 3,q{4) = 4. 
Thus, the (in this case identical) invariances 

f{xi,X2,X2,Xi) = f{x2,Xi,X2,Xi), f (xi , X2, Xi, X2) = f (X2, Xi, Xi, X2) 

can be preserved in the normal form of /. These are precisely the invariances that make 
Xp : (xi,X2) {x2,xi) a symmetry of the differential equations. A 
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9 SN-decomposition 

We recall from the previous sections that when fo G L(V", V), then adf^ : P'' — > P'''. The 
operators ad^^lpfc are called "homological operators" and they play an important role in 
normal form theory. This is first of all because the normal form spaces 

j^k ^ pk q£ Theorem 



16.11 must be chosen complementary to their images, and secondly because in computing a 
normal form one needs to "invert" them when solving the homological equations &A^^{gk) — 
hk £ A'^'', see the proof of Theorem l6.1l 

For this reason, it is convenient to have at one's disposal the "SN-decompositions" (also 
called "Jordan-Chevalley decompositions" ) of the homological operators [3, [12] i HZ]- Were- 



call that, since P'^ is finite-dimensional, the map ad? |pfc admits a unique SN-decomposition 



ad/oipfc = (ad/JpO -l-(ad^Jpfc) (9.23) 

in which the map (ad^^j [pfc is semisimple, the map {adf^\pk)'^ is nilpotent and the two 
maps (ad^glpk)^ and (ad^^jlpfc)^ commute. The aim of this somewhat technical section is 
to characterize this SN-decomposition in an as simple as possible way. We will do this in a 
number of steps, starting from the following technical result; 

Proposition 9.1 Assume that is a semigroup. Then the Imear map 

"i\L{v^,v) ■ L{V",V) — >■ L{V^ ,V^) sending fo to 7/^ is tnjective . 

Proof: The definition (7/f,)i := fooni implies that when fo is linear, then 7/^, = precisely 
when /o vanishes on im tti -|- . . . + imTrjv. Thus, all we need to show is that 

im TTi -|- . . . -|- im TTjv ~ V" . 

Equivalently, we will show by contradiction that the map 

"1 I 1) ri^NsN , -rrn / (1) (N)s , / (1)n , , / (JV)n 

must be surjective. To this end, let us define for 1 < j < n the maps 

: (V^^)^ by .^■(:c(^\ . . . = (7ri(xW) + . . . + .^(x(^')), = :c^',,, +. . . + 

In other words, n-' is "tti -|- . . . + -km" followed by the projection to the j-th factor of V"\ In 
particular, if "tti -|- . . . -f ttjv" is not surjective, then there is a relation of the form 

n 

TT"' = y ^ Afcvr'' . 

This means that 

xi% + ... + x^fj,^ = ^ A. (.W + . . . + x^fj,^) for all , . . . , e . 

It is clear that this can only be true if aj = ak for some k j. This is a contradiction, 
because we assumed that the elements of E are distinct. □ 

Next, we recall that when fo G L{V",V), then 7/;, G L(V'^,V^) and thus also the latter 
has an SN-decomposition 

S , N 

7/0 = 7/0 + 7/0 

for certain 7/^,7/^ G L{V'^ , V'^). We are going to relate the SN-decomposition of 7/,-, to 
that of &dj^\pk. But first we show that both 7^^ and 7^ are coupled cell network maps: 

Lemma 9.2 For every fo G LCV"^, V) there exist unique fo , fo £ L{V" , V) so that 

7/0 = 7/s and 7^ = 7^™ . 
It holds that fo = fo ^ fo' and that [fo , /o^ls — 0. In particular ad?s oad?jv ~ ad?jv oadfs . 

Jo Jo Jo Jo 
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Proof: We recall - see for instance [33, pp. 17 - that both the semisimple part 7^^^ and 
the nilpotent part 7^ of 7/0 are polynomial functions of 7/^. More precisely, 7^^^ = p(7/o) 
^^'^ 'yfo ^ 'yfo -P(7/o). where 

Pif) = aol + ai7 + • ■ • + a-d'y'' 

is a polynomial with coefficients ao, . . . , £ C. 

Theorem 14.21 then implies that 7^^^ = p(7/o) ~ 7p{/o) = 7/s for fo £ L{V", V) defined as 

fo = p{fo) = ao/o + ai(/o oe /()) + ... + a4fo os . . . os /o) . (9.24) 

By Lemma 14.31 this /(f is well-defined, while by Proposition 19.11 it is unique. Similarly, 
'yfo = 7/« for a well-defined and unique /o^ = fo -p(/o) £ L(V",V). Clearly, fo = fi + f^. 
Because [fi , fS'h G i(V", V) and 

7[/o^,/o"1e = [7/;f '7/«] = [7/0, 7ft] = 

it follows from Proposition 19.11 that [/(f ,/o^]e ~ 0. The Jacobi identity 

[ad^s,ad^Nl = adHs j-wi 
L /o ' fo ' [fo 'fo Is 

then confirms that adfs and ad^w commute as operators on C°°(V" , V). □ 
fo Jo 

Before we come to the desired characterization of the SN-decomposition of ad^^^lpfc, we need 
to make one simple observation. It concerns the fact that two functions f,g£ C°°{V'^, V) 
generate the same network map (in the sense that 7/ — 79) if and only if / — g £ ker7 = 
{ft I 7/1 = 0} C C°°{V",V). Thus, ker7 consists of those functions h : V" ^ V that are 
irrelevant for the dynamics of coupled cell networks. 

One can remark that when f,g G C°°{V",V) and / G ker7, then 'y[f,g]-^ ~ [7/, 79] ~ 
and hence also [/, jrjs G ker7. This means ker7 C C°° {V" ,V) is a Lie algebra ideal. In 
particular it holds for every / G C°°(V",V) that the adjoint map ad^ : C°°{V",V) 
C°° {V" ,V) sends ker7 to ker7 and hence that ad^ descends to a well-defined map on 
C°°{V"', l^)/ker7. We can now formulate our result: 

Theorem 9.3 For every fc = 0, 1, 2, . . . the maps 

(ad^iJpfc)^ and ad^sj ^ respectively {a.d^^\ pk)^ and ad^w | ^ 
descend to the same map on P''/ker-y. 

Proof: We start by repeating that ad^^ maps ker7 into itself and hence descends to 
a well-defined map on C°°(V", V)/ ker 7 that moreover sends P'^/ker7 into itself. More 
interestingly, since (^a.dfg\ pk)^ and (^adf^lpk)'^ are polynomial functions of ad^^lp*:, also 
these latter maps send ker7 into itself and thus descend to P''/ker7. 

For the actual proof of the theorem, we define for fe > the vector spaces 

■p'' := {homogeneous polynomial vector fields on of degree fc -I- 1} . 

It is clear that 7 : P''Yker7 — > p'' is an injective linear map. Moreover, the computation 

(7°ad^J(gfe) = 7[/o,9felB = [7/0. 79J = (ad^^^, oi){9k) 

reveals that the maps ad^^^ : P'''/ker7 — >■ P'°/ker7 and ad.y^.^ : P*^ P*^ are conjugate by 
the map 7 : P'°/ker7 p''. Similarly, ad^s is conjugate to ad^. ^ and ad^w is conjugate 

^0 fo ■'0 

to ad^ „ . Now we recall the well-known fact that the SN-decomposition of ad-y^ \j,k is 
a.d-, \j,k = (ad^ Ipfc) + (ad^ 1^^) = ad s | + ad « I = ad^ I + ad^ I . 

\ / \ / 'fo Ipfc 'fo l-pfc fo Ipfc JQ l-pk 

Because 7 is injective, we have thus proved that 

ad5„ = ad?s -f ad?jv : P*/ ker7 P'°/ker7 

I pfc Jo I pfc Jo I pfc 
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is the SN-decomposition of the quotient map. Because the SN-decomposition of the quotient 
is the quotient of the SN-decomposition, this proves the theorem. □ 



Because the elements of ker7 are dynamically completely irrelevant, for all practical purposes 
we can think of Theorem 19.31 as saying that 

" ad?,, = ad?s + ad^w is the SN-decomposition of ad?, " . 

^"\pk Jo \ pk Jo \pk \ pk 



This is very convenient, because it means that one can determine the SN-decompositions of 
all operators ad^^^j^^ simultaneously by simply determining the splitting /o — fo + fo'. 

Example 9.4 Even though by Proposition 19.11 the restriction 71l(v",v) is injective, the 
full map 7 : C°°{V",V) C°°(y^,y^) may fail to be so. This situation occurs when 
because 7/ = already when / vanishes on every imTr^. This is the reason 
for the somewhat difficult formulation of Theorem 19.31 

To illustrate this phenomenon, we refer to Example 18.51 in which 



Tri{xi,X2) — (xi, 2:2, 2:2, xi) and 712(2:1, 3:2) — {xi, X2,xi,X2) , 

so that in particular imvri U im7r2 7^ V^. When for instance V = R in this example, then 
ker7 C C°°(R'',K) is the ideal generated by 

(Xi - X4){Xi - X3), (Xi - X4){X2 - Xi), {X2 - X3)(Xi - X3) and {X2 - X3){X2 - Xi) . 

A 

We conclude this section with the following dynamical implication of Theorem 19.31 

Corollary 9.5 Let < r < 00. Then it can be arranged that the normal form f ~ fo + 
7i . . . e C°°(V", V) 0/ an / = /o 4- 7i + . . . G C°°(V", V) has the special property that 
the truncated normal form coupled cell map/vector field 7^^^^j^^ commutes with the 

continuous family of maps 

t ^ e '0 . 

Proof: Recall that each one of the normal form spaces A^*^ C of Theorem l6.1l is required 
to have the property that N*^ ® im adj^^jj^^. — P^ . It is not hard to see that whenever 

N'' C ker (ad^ij jpfc is complementary to im (ad^^ jpt (9.25) 

then this condition is fulfilled. Thus, let us choose A'^* so that it satisfies (|9.25|l . The fact 
that (adfslpfc I and ad.s descend to the same map on P*/ker7 implies in particular 

V ■'0 / ■'0 \pk 

that for such iV''' it holds that ad^.s(iV''') C ker7. 

Let now / = /o + /j^ + + . . . be any normal form of / of order r with respect to the 
A*'*, meaning that /j. £ A*'*' for all 1 < fc < r. Such a normal form exists by Theorem 16.11 

Then it holds that ad^s(/^) G ker7 and in view of Theorem 14.21 we therefore have 

■' 

['''/(f''^/0+7l. + = '>'[/o^,/o+7l + ...-l-7rls ^ '^ad^<,(/o+7l + . •. + /.) 

J n 



dt\t^ 

the fiow t M. e ^0 of the coupled cell network vector field 7j^s. □ 



-0 )* ('^/o+7i +7 ) ~ a'^d thus the truncated normal form commutes with 

V e''^o of tl 

The continuous family 



t7,S 

e •'^0 



of transformations of is called a normal form symmetry. This symmetry is sometimes 
used to characterize vector fields that are in normal form. It also plays an important role in 
finding periodic solutions near equilibria of the vector field 7/, using for example the method 
of Lyapunov- Schmidt reduction [12], [23], [21], [33], [33 ■ 
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10 A fundamental semigroup network 

As a byproduct of Theorem 14. II and perhaps as a curiosity, we will show in this section that 
the dynamics of 7/ on V'^ is conjugate to the dynamics of a certain network F/ on V" . We 
will argue that F/ acts as a "fundamental network" for 7/. 

We recall that if E = {cti, . . . ,a„} is a semigroup, then every aj £ E induces a map 

(Tj : {1, . . . , n} — s- {1, . . . ,n} via the formula cr5j(fc) ~ (Ju o Uj ■ 

We saw that o-jj o Gj^ = CTj^ o ct^^ and hence the collection E ~ {cti, . . . , is closed under 
composition. One can now study coupled cell networks subject to E. They have the form 

F/ : \/" -> l^" with (F/),(X) := /(Xj^f^,, . . . = f{A„,X) for aU 1 < j < n . 

The following theorem demonstrates that 7/ and F/ are dynamically related: 
Theorem 10.1 All maps Hi : V" conjugate 7/ to F/, i/iat is 

F/ o TTi = TTi o 7j^ for all 1 < i < N . 
Proof: For x £ we have that 

□ 

Theorem 110.11 implies that every tt; sends integral curves of 7/ to integral curves of F/ and 
discrete-time orbits of 7/ to discrete-time orbits of F/. 

In addition, the dynamics of 7/ can be reconstructed from the dynamics of F/. More 
precisely, when are integral curves of F/ with X(i)(0) = 7ri(a;(0)), then an integral 

curve x{t) of 7/ can simply be obtained by integration of the equations 

i,W = /(X(,)(t))forl<i<iV. 

Similarly, if X^^^ are discrete-time orbits of Ff with Xj'™'(0) = ■Ki{x{0)), then x^"^^^^ := 

/(Xj'™') defines a discrete-time orbit of 7/. 

The transition from 7/ to F/ is thus reminiscent of the symmetry reduction of an equivari- 
ant dynamical system: the dynamics of 7/ descends to the dynamics of F/ and the dynamics 
of 7/ can be reconstructed from that of F/ by means of integration. Nevertheless, n can of 
course be both smaller and larger than A''. In the latter case, the dynamics of F/ may be 
much richer than that of 7/ and it is confusing to speak of reduction. In either case, F/ 
captures all the dynamics of 7/. 

Example 10.2 Again, let A = 3 and let ai, a2, (T3 be defined as in Example 12.31 Recall 

A„,{Xi,X2,X3) = (Ai,A2,A3), 

Aa-2 (Al, A2, A3) — (A2, A3, A3) , 
j4a-3 (Al, A2, A3) — (A3, A3, A3) . 

This means that the network map Fy is given by 

F^(Ai,A2,A3) = (/(Ai,A2,A3),/(A2,A3,A3),/(A3,A3,A3)). 
In this example, the conjugacies from 7/ to F/ are 

TTi : {xi,X2,X3) !->• (Al, A2, A3) := {xi,xi,xi) , 

TT2 ■■ {xi,X2,X3) !->• (Al, A2, A3) := {x2,Xl,Xl) , 
■K3 : {xi,X2, X3) !->• (Al, A2, A3) ■— (X3, X2, Xi) . 

The conjugacy tts is bijective, which explains that Figures [T] and |3] are isomorphic. 

A 
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Figure 4: The fundamental network of our three-cell feedforward network. 

Example 10.3 Recall Example 18.51 that features a semigroup with 4 elements. To deter- 
mine the maps Aa^ , we compute the multiplication table of this semigroup: 



o 




0-2 


0-3 


0-4 




o-i 


o-i 


CTl 


CTl 






0"2 


0-2 


(72 






o"i 


0-4 


<73 


£74 


CTl 


0"2 


0-3 


0-4 



This implies that 

Aai{Xl, X2, X[i, X4) = (Xl, X2, X2, Xl), 
Aa-2{Xl, X2, X3, X4) — (Xl, X2, Xl, X2), 
(Xl , ^2, -^^3, -^^4) = (Xl , X2, X4, X3), 
Ao-4 (Xl, X2, X3, X4) — {Xl, X2, X3, X4). 

Hence, the corresponding fundamental network is given by 

Xi = f{Xi,X2,X2,Xi), 

X2 = f{Xi,X2,Xl,X2), 

X:i — /(Xi, X2, X4, X3) , 
X4 — /(Xi, X2, X3, X4) . 

This fundamental network has been depicted in Figure [S] It is clear that the maps 

TTl : (xi,X2) (Xl, X2, X3, X4) ~ {xi,X2, X2, Xl) , 
7r2 : (xi,X2) t-S- (Xi,X2,X3,X4) ~ (xi, X2, Xi, X2) 

conjugate 7/ to F/. A 

The advantage of studying F/ instead of 7/ is that the definition (F/)j := f o Ac ■ explicitly 
displays the representation of the semigroup E, whereas the definition (7/)i := f om clearly 
does not. This has as a consequence that the transformation formulas for the composition 
and the Lie bracket become completely natural: 

Lemma 10.4 It holds that 

T/ ° Tj, = F/oss and [F/, F^] = F[j.,g]j, . 

Proof: First of all, 

A^^igiA^.X), . . .,g{A^^X)) = (g(A.,^,^,X), . . . , ^(A.,^^, X)) 
= (ff(^<Tioa,X),...,(;(yla,.oa,X)). 
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Figure 5: A fundamental network with n = 4. 



This gives that 

(r^ o r,),{X) = f{A„^ {9{A,,X), . . .,g(A„„X)) = f{g{A^,,„^X), . . . ,g{A^„,„^X)) = 
f{g{A^,iA^^X)),...,g{A^JA^^X))) Hfo^g){A^^X) = (Tf^^^UX). 

The computation for the Lie bracket is similar. □ 

We stress that Lemma 110.41 holds due to the definition (r/)j := / o Acr^ and the fact 
that (Tj H->- j4o- . is a homomorphism. Lemma 110.41 implies for example that the symbolic 
computation of the normal form of F/ is the same as the symbolic computation of the 
normal form of 7/. 

We propose to call F/ the fundamental network of 7/. Two properties make this fun- 
damental network fundamental: first of all, the network architecture of the fundamental 
network only depends on the multiplicative structure of the semigroup E and not on the 
explicit realization of E itself - in particular, it does not depend on A'^. This means that two 
semigroup networks have isomorphic fundamental networks if and only if their semigroups 
are isomorphic. The second fundamental property of the fundamental network is that it is 
equal to its own fundamental network, if the latter is defined. This follows from Proposition 
110.51 below, in which we call a homomorphism of semigroups faithful if it is injective. 

Proposition 10.5 Assume that the homomorphism M- aj is faithful. Then 
cTj — aj and therefore A^- — As- for all 1 < j < n . 

Proof: Recall that E — is closed under composition. Thus, the condition 

that the homomorphism aj n- aj from E to E is faithful just means that E is a semigroup. 
In particular, each map aj : {1, . . . ,n} — >■ {1, . . . , n} is then well-defined. Now we compute 

= 5j ° 5fc = crTo^fe = 5^-, = as-(k) ■ 

This proves that aj — aj for all 1 < j < n and hence that As^ = Acr^ for all 1 < j < n. □ 

Proposition 110.51 brings up the question when the homomorphism aj aj is faithful, i.e. 
under which conditions the elements of E all have different left-multiplicative behavior. We 
give a partial answer to this question in Remark 110.91 below. The upshot of this remark is 
that one may essentially always assume the homomorphism to be faithful. 
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We finish this section with a few simple observations on synchrony and symmetry for F/. 
First of all, a direct consequence of Theorem 110.11 is that each im m C V" is an invariant 
subspace for the dynamics of F/. Interestingly, another way to see this is by the following 

Proposition 10.6 Every im-Ki C V" is a robust synchrony space for the F/ 's. 

Proof: Let us define a partition P of {1, . . . ,n} by letting 1 < ji,j2 < n be in the same 
element of P if and only if aj^ (i) — aj^ (i). Then 

Synp = {X e V"\Xj^ = Xj^ whenaj-^{i) = aj^{i)} = {(x^^;,), . . . ,a;^„(i)) \x £ V^} = imTr, . 

It remains to show that the partition P is balanced for E. This is easy though: when 
1 < ji, J2 < ri are in the same element of P, then it holds for all 1 < fc < n that 

where the middle equality holds because <7ji{i) ~ o"j2(*)- This proves that also and 
5fe(j2) are in the same element of P and hence that the elements of E preserve P. □ 

Recall that Aa^ o m — n^. (i) . This implies that Acr^ sends the F /-invariant subspace im m 
to the F/-invariant subspace im-Ka-^(i). But much more is true: the following result shows 
that Aaj sends all orbits of F / to orbits of F/ , even though Aa^ may not be invertible. 

Proposition 10.7 

Vf o A^^ = A^^ o Vf . 

Proof: 

[Tf o A„^),{X) = f{A„, o A^^X) = f{A„,o.,X) = 

□ 

The final result of this section shows that Ff may even have more symmetry: the dynamical 
input symmetries of 7/ are true symmetries of F/. 

Proposition 10.8 If p is a permutation of {1, . . . , TV} and q is a permutation of {1, . . . , n} 

so that po aj — (Jq(j) o p for all 1 < j < n and if f o \q o m — f o m for all 1 < i < N , then 

Tfo\q = \qoTf on every im TVi . 

Proof: Recall that under the conditions of the proposition, it holds that niO \p — XqO TTpji) 
and that from this it followed that Ap o 7/ = jf o Ap. As a consequence, 

F/ O Ag O 7rp(i) = F/ O TTi O Ap = TTi O 7/ O Ap = TTi O Ap O 7/ = Aq O 7rp(i) O 7/ = Ag O F/ O 7rp(i) . 

Because p is a permutation, this means that 7/ o A, = A, o 7/ on every imTr^. □ 

Remark 10.9 To explain when the homomorphism Oj 1— !> aj is faithful, we can make the 
following definition: we say that 1 < i < A*' is a slave for the network E if there are no 
1 < J < and 1 < fc < A^ so that (Jj(fc) = i. Thus, a slave is a cell that does not act as 
input for any other cell, not even for itself. The point of this definition is the following: 

Proposition 10.10 //E has no slaves, then aj 1— >■ aj is a faithful homomorphism. 

Proof: The relation aj^ = aj^ means that aj-^ o at ~ Oj^ o Ok for all fc. This implies in 
particular that (7_,j = Oj^ on imafc for all k. But if E is free of slaves, then Uj=i™'^j ~ 
{1, . . . , A}. Hence, Oj^ = Oj^ . □ 

If a network has slaves, then we can reduce it until no slaves remain. This works as follows: 
first of all, we remove any slave from the network. Because slaves do not affect the dynamics 
of other cells, this can be done without any effect on the network dynamics. Removing slaves 
may create new slaves: these are the cells that acted as inputs only for the original slaves. 
These new slaves can also be removed, etc. until a network free of slaves remains. 
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The remaining network may not be defined unambiguously, because some of tfie maps 
in E may coincide after the removal of the slaves. This happens when distinct maps in E 
differ only at slaves. Such maps can be identified though, while / must be redefined. In this 
way, we produce an unambiguous network that is free of slaves. For such a network 7/, the 
corresponding F/ is a true fundamental network. A 



11 Some examples and their normal forms 

In this section we illustrate the methods and results of this paper by computing the normal 
forms of two coupled cell networks. Keeping things simple, we restrict our attention to 
synchrony breaking steady state bifurcations in one-parameter families of networks with 
one-dimensional cells. 



11.1 A skew product network 

In the first example, we consider the homogeneous skew product differential equations 



xi = /(xi,a;i; A) , 
±2 = f{x2,xi;X) . 



(U.26) 



Here xi,X2 G R and / 



As usual, we will denote the right hand side of (|11.26[l 



by ^f{xi,X2; A) and we will henceforth assume that 

7/(0, 0; 0) = and -0^:7/(0, 0; 0) is not invertible. 

This means that at the parameter value A = 0, the origin {xi,X2) = (0,0) is a fully syn- 
chronous equilibrium point of (|11.26|) that undergoes a steady state bifurcation. We wish to 
study the generic nature of this bifurcation. So let us write 

/o,o(Xi,X2) = Dxf{0,0;0)(Xi,X2) = aiXi + aaXa with ai,a2 £ R. 

With this notation, we have that 



matD,7/(0,0;0) 



ai + 02 
02 ai 



We remark that this linearization matrix is semisimple. And moreover that a steady state 
bifurcation occurs when one of its eigenvalues ai + a2 or ai vanishes. 

The obvious but important remark is now that equations (|1L26|) define a semigroup 
coupled cell network. The corresponding semigroup consists of cti and a2, where 

cri(l) = l,cri(2) = 2 and (72(1) = 1,(72(2) = 1. 

We depicted this network in Figure [S] 





Figure 6: A homogeneous skew product network. 



The composition table of {(71,(72} reads 






C7l 


(72 


(71 


(71 


(72 


(72 


(72 


(72 
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Prom this table, we can read off that 



A^^{Xi,X2) = (Xi,X2) , A^^{Xi,X2) = (X2,X2), 
and hence that the symbolic Lie bracket of this network is given by 

[/, 5]e(Xi, X2) =Dl/(Xl, X2)<?(Xl, X2) + D2f{X,,X2)giX2,X2) 

-Dig(Xi, X2)/(Xi, X2) + i32s(Xi, X2)/(X2, X2) . 

Since Dx"/f{0, 0; 0) is semisimple, so is ad^^ ^ : P*''' — >• P*"'' for every k > —1 and / > 0. Its 
kernel determines the normal form of /. It only requires a little computation to check that 

,E / (Xi - X2)"X2^ 1-^ [(1 - a)ai - 3{ai + 02)](Xi - X2)"X2^ for a > 1 and ^ > , 
ad/0,0: I ^ (i_^)(a^ + a2)X| for/3>0. 

This formula nicely confirms that adj^j ^ is semisimple. We now consider the two different 
codimension one cases: 

1. When ai+a2 = but ai ^ then the kernel of Dj:^f{0, 0; 0) is tangent to the synchrony 

space {a::i = X2}. In this case, the kernel of ad^^^ ^ is spanned by elements of the form 

(Xi — X2)X2 and Xj , where /3 > 0. Thus, the general normal form of / is 

7(Xi,X2;A) = (Xi -X2)F(X2;A) + G(X2;A), 

with F(X2; A) = ^(A) + C(Xi), G(Xi; A) = B(A) + C(A)Xi + D(A)X? + 0{Xl) and 
A{0) = oi, B(0) = C(0) = 0. The normal form equations of motion become 

XI = G{xi; A) , 

X2= G{xi;X) + {x2-xi)F{xi;X). 

This implies first of all that the stationary points of the normal form satisfy xi = X2 
and secondly that xi solves the equation G{xi; A) = B(A)+C(A)a;i+-D(A)a;f + 0(a;i) = 
0. Under the generic conditions that B'{0),D{0) ^ 0, we thus find the saddle node 
branches 

xi=X2 = ±^{-B'{0)/D{0))\ + OiX) 

of synchronous steady states. A straightforward stability analysis reveals that one of 

these branches consists of equilibria that are linearly stable in the direction of the 
synchrony space, while the other branch consists of unstable points. We remark that 
the saddle node bifurcation is also generic in codimension one in the context of vector 
fields without any special structure. 

2. When ai + 02 7^ and ai = 0, then the kernel of adj^ ^ is spanned by elements of the 
form (Xi — X2)", where a > 1, and the element X2. Hence the general normal form 
of / is given by 

7(Xi,X2;A) = (Xi -X2)F(Xi -X2;A)+A(A)X2, 

with F(Xi -X2;A) = B(A) + C(A)(Xi-X2) + 0(Xi-X2)2 and yl(0) = 02, 5(0) = 0. 
The normal form difi^crcntial equations are 

xi = A{X)xi , 

X2 = A{X)xi + {x2 — xi)F{x2 — xi; A) . 

This implies that the stationary points of the normal form satisfy xi = 0, while either 
X2 = or X2 solves the equation F{x2; A) = B{X) + C{X)x2 + 0{x%) = 0. Under the 
generic conditions that -B'(O), C(0) 7^ 0, we thus find the two steady state branches 

xi=X2^0 and xi =0,X2^ {-B'{0)/C{0))X + 0{X^) . 

These branches exchange stability when they cross. This means that the normal form 
displays a synchrony breaking transcritical bifurcation. Such a bifurcation is not generic 
in codimension one in the context of vector fields without any special structure, and is 
hence forced by the network structure. More precisely, it follows from the presence of 
the invariant synchrony space. 
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11.2 A nilpotent feed- forward network 

Next, we consider differential equations with the network structure defined in Example 12.31 

= /(s^i, a;i; A) , 
X2 = f{x2,xi,xi; X) , (11.27) 

±3 = f{x3,X2,Xi;X) . 

Here xi,X2,X3 G R and / : x R — >■ R. Again, let us write 

fo,o{Xi,X2,X3) = Dxf{0,0,0;0){Xi,X2,X3) = aiXi + a2^2 + 03X3 for ai,a2,03 £ R. 
Then it holds that 

Cai +a2 + as 
a2 + as ai 
az a2 

This shows that a steady state bifurcation takes place when either ai + 02 + (13 = or ai =0. 
Moreover, the linearization matrix is not semisimple. In fact, its SN-decomposition reads 

(fli + 02 + aa \ / ai + 02 + as 
0.2 + as ffli ~ 02 + as ai 

as ffl2 tsi / \ 02 + 03 oi 

As a consequence, we should accordingly decompose /o,o as 

,fo,o = flo+.fo.o where /q^,, (^1 , X2 , X3) = oiXi + (02+03)^3 , /,^^o (^1 , X2 , X3) = 02 (X2 -X3) . 

Recalling that for this network the expression for the symbolic bracket is given in Example 
15.31 it again requires a little computation to find that 

(X2 (1 -7)(ai +02 + 03)A-^ for7>0, 

adj.s ■.l{X^-XzT{X2-X3fX'< ^ 

[ [(l-a-/3)ai-7(oi + a2 + a3)](Xi -X3)"(X2 -X3)''X3^ for q + /3 > 1, 7 > . 

and similarly that 

({Xi~Xzr{X2~X3y'X^ ^ 

-ao2(Xi -X3)"-'(X2 -X3)'^+'X^ for a,^ > 1,7 > 0, 

(Xi - Xsrx; ^ 

a2{X2 - XsTX; ~ aaiiXi - X3)°'-''{X2 ~ X-i)X; fora> 1,7>0, 
^{X2-X3fX] ^->0 for/3,7>0. 




ad ,jv 

JQ.O 



Once more, we now consider the two codimension one cases: 

1. If oi + 02 + 03 = and oi 7^ 0, then the kernel of adj^^ ^ is spanned by terms 

(Xi - X3)X], {X2 ~ X3)X^ and X^ with 7 > . 

One checks that ad^w^ vanishes on this kernel, so the general normal form of / is 

7(Xi, X2, X3; A) = (Xi - Xz)F{X3- A) + (X2 - Xz)G{X3- A) + Hi^Xz; A) , 

where F(X3;A) = A[\) + 0[Xz), G{Xz;X) = B(A) + 0{Xz), H{Xz;X) = C(A) + 
D(A)X3 + E{X)Xi + 0{Xi) and A{0) = oi, B(0) = 02, C(0) = D{0) = 0. The normal 
form equations of motion are 

ii = H{xi- A) , 

±2 = (x2 - A) + H{xx; A) , (11.28) 

xz = (xz - xi)F{xi; A) + {x2 ~ xx)G(xx\ A) + Ii(xx\ A) . 

It follows that the steady states of the normal form satisfy x\ = X2 = xz, where x\ 
satisfies jy(cci; A) = C{X) + D(X)xy+E{X)x\^0(x\) =0. Under the generic conditions 
that C'(0),-E(0) 7^ 0, this yields the fully synchronous saddle node branches 



X\ 



= X2 = X3 = ±\/-(C"(0)/£;(0))A + 0(X) . 



Again, one of these branches is stable and the other one is unstable in the direction of 
the maximal synchrony space. 
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2. When ai = 0,a2 7^ and ai + 02 + 03 7^ 0, then kerad^s is spanned by the elements 

X3 and (Xi - X3)"(X2 - Xs f with a + P > 1 . 
This time the action of adf « on ker ad^s is nontrivial. The only terms in the kernel 

^0,0 ■'0,0 

that are not in im ad^w^ are actually those of the form 

{Xi ~ X-i)",X2 - X3 and X3, with a > 1 . 

This means that the general normal form of / is 

J{Xi,X2,Xr,\) = {Xi - X3)F{Xi - X-s) + A{\){X2 - X3) + B{\)X3 , 

where F{Xi - X3) = C(A) + D{X){Xi - X3) + 0{Xi - Xaf and A{0) = a2, B{0) = 
ai + a2 + a-i, C(0) — 0. This gives the equations of motion 

sci = B{X)xi , 

±2 = B{\)xi + {X2 - xi)F{x2 - xi; A) , (11.29) 
±3 = B{\)xi + A{X)(x2 - xi) + {xa - xi)F{xa - xi;\) . 

Under the generic assumption that C'(0),-D(0) 7^ 0, we now find three branches of 
steady states: 

Xi = a;2 = a;3 = , 

xi=X2= 0, X3 = -(C'(0)/D(0))A + O(A') , (11.30) 
xi ^0,X2 = ~(C'(0)/D(0))A + Oi\^),X3 = ±x/(a2C"(0)/D(0)2)A + 0(A) . 

This means that our normal form equations undergo a very particular synchrony break- 
ing steady state bifurcation that comprises a fully synchronous trivial branch, a par- 
tially synchronous transcritical branch and fully nonsynchronous saddle-node branches. 
The solutions on these branches exchange stability in a specific way, as for example 
depicted in Figure [T] 



- + 




Figure 7: Bifurcation diagram of a codimension-one steady state bifurcation in the normal form of a three cell 
feedforward network. Pluses and minuses refer to positive and negative eigenvalues in the eigendirections other 
than the maximal synchrony space. This figure depicts the solutions of formula l|11.30p in case a2, C"{0), D{0) > 0. 



12 Colored coupled cell networks 

In this final section, we describe how our results on homogeneous coupled cell networks 
generalize to certain non-homogeneous coupled cell networks. So let us imagine a coupled 
cell network with cells of different types. We will refer to the different types of cells as colors. 
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More precisely, let us assume that there are 1 < C < oo colors and that for every color 
1 < c < C there are precisely Nc cells of color c. We label the cells of color c by 1 < i < Nc 
and assume that the state of the i-th cell of color c is described by x['^^ G Vc, where 14 is a 
linear space that depends on c. 

We furthermore assume that the discrete- or continuous-time evolution of x'f'' is deter- 
mined by precisely nji ,,) cells of color 1, by n(2,c) cells of color 2, etc. This assumption is 
made precise in Definition [T2]T] below that, although lengthy, is a straightforward generali- 
zation of Definition 12.11 



Definition 12.1 For every 1 < c, d < C and every 1 < j < c), assume there is a map 

af^' :{1,...,7VJ^ {!,..., TV,} . 
We denote the collection of these maps by 

Next, we define for all 1 < c < C and 1 < i < A^c the maps 

Tvl^^ : <i X . . . X V^^ ^ V,"''^- X ... X V^^'^ by 

.t.{C)n ._ [ (1) (1) . . (C) (C) 

Now assume that / = {f^-^\ . . . , f^'^^) is a collection of functions, with 

: \/;<^-' X ... X i/;<^-' K . 

Then we define 7/ : Vj^^ x . . . x V^'^ V^^^ x . . . x y;f 

(7/),"' := .f^"^ ° for all 1 < c < C and 1 < i < AT^. 
We say that 7/ is a colored coupled cell network map/vector field subject to E. A 
It is important to note that only the compositions 



{1,...,N,}^ {1,...,N,} 



are sensibly defined. This inspires the following definition: 

Definition 12.2 We say that E is a semigroupoid if for every 1 < c,d,e < C and every 
1 < ji < rid^c and 1 < J2 < ?ie,d there is precisely one 1 < js < ne,c such that 

fe,d) fd.c) fe,c) 

a) ' o a) ' — a) ' . 

31 32 33 

A 

When a collection E as in Definition 112.11 is not semigroupoid, then it generates one: the 
smallest semigroupoid E' containing E. 

Example 12.3 The completely general C-dimensional differential equation 

^ . . . for 1 < c < C and a;'"' e K 

is an example of a colored coupled cell network with C colors and one cell of each color. The 
elements of E = {a[^'^^ ; . . . ; cr^''^''} are all defined by crj'*''^-'(l) — 1. They obviously form a 
semigroupoid. A 

Example 12.4 The general 2-dimensional skew product differential equation 

with x^^^ G Vi and x'^-* G V2 is an example of a colored coupled cell network with two colors 

fll") ('12') fSSl 

and one cell of each color. The elements of E = {a\ ' ,a[ ' , crj ' } are all defined by 
^{d,c)j-^^ _ ^ thus form a semigroupoid. See Figure |8] 

A 
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Figure 8: A colored skew produet network. 



Example 12.5 The 3-dimensional differential equation 

with ajj^-*, ajj^-* € Vi and a::^'^' £ V2 is an example of a colored coupled cell network with two 
colors: two cells of color 1 and one cell of color 2. Here, S — {a[^'^\a[^''^^ ; a['^'^^} where 
these maps are defined by 



a['-'\l) = 2,<'^'(2) = 2;<'^'(1) = 2;ar'^'(l) = l,ar'^^(2) = 1 
Again, one quickly checks that E is a semigroupoid. See Figure [5] 



,{1,2) 



(2,1)/ 





Figure 9: An example of a colored network with three cells of two colors. 

A 

Under the condition that E is a semigroupoid, all results of this paper on Lie algebras and 
normal forms can be generalized to colored coupled cell networks. As an illustration, we 
state a few facts here without proof. 

Theorem 12.6 // E ts a semigroupoid, then for each aj'*''^'' £ E there is a unique linear 



X K 



'(C,c) 



such that for all 1 < i < Nc it holds that 



A (c) (d) 



(i) 



These maps satisfy the relations A (e.d) o A (d.c) = A (e,d) (d.c) and thus form a represen- 

31 J2 31 32 

tation of the semigroupoid E. 
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Theorem 12.7 //S is a semigroupoid, then 

in which ( f os gY'^^ is equal to 

o ( o A (i.c) X ... X 3'^' o A (1,., X ... X 5<<^^ o A (CO X ... X C/(^> o A (c,c) ) . 

Theorem 12.8 If T, is a semigroupoid, then 

[7/, 79] = 7[/,9]5: 

in which [/, g]^^ equals 

. . V j J j j J 

In turn, Theorem 1 1 2 . 71 can be used to prove normal form theorems for colored coupled cell 
networks. That is, the theorems of Sections|6]and|9]remam true with the word "semigroup" 
replaced by "semigroupoid". 

We conclude with two results that say that the network symmetries and the robust 
synchrony spaces of a network remain unchanged by the semigroupoid extension. 

Lemma 12.9 Let E he as in Definition \12.1\ not necessarily forming a semigroupoid, and 
let p be a permutation of the cells so that the restriction p : {l,...,A'^c} — >■ {1, ■ ■ ■ , Nc} 
preserves the cells of each color. We say that p is a network symmetry if 

p o (T^'*"'^' — (jj'*''^' o p for all 1 < c, d < C and all 1 < j < nj^j • 

This means that Xp sends orbits of^f to orbits of^f. 

Then the collection of network symmetries of E is the same as the collection of network 
symmetries of the semigroupoid E' generated by E. 

Lemma 12.10 Let E be as in Definition \12. 1\ not necessarily forming a semigroupoid, and 
let P = {P'^', . . . , P'*^'} be a collection of partitions, i.e. for all! < c < C, we have that 
p(c) _ ^p^'^^ ^ . . . ^ -Pre'} ^■^ partition of {1, . . . , Nc}. Then the following are equivalent: 

1) The collection of partitions is balanced, i.e. for alll < c,d < C, all 1 < j < 'T-(d,c) o-nd 
all 1 < k\ < rc there exists a 1 < k2 < rd so that o-^'^'''\Pj^f) C Pj:'^^ ■ 

2) The subspace 

SyUp ~{x£ V^^ X ... X V^^ I x'f^ — x^"^ when ii and 12 are in the same element of P^'^^} 

is a robust synchrony space for the networks subject to E. 

The collection of robust synchrony spaces of E is the same as the collection of robust syn- 
chrony spaces of the semigroupoid E' generated by E. 
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